On Herding and the Perceptron Cycling Theorem
نویسندگان
چکیده
The paper develops a connection between traditional perceptron algorithms and recently introduced herding algorithms. It is shown that both algorithms can be viewed as an application of the perceptron cycling theorem. This connection strengthens some herding results and suggests new (supervised) herding algorithms that, like CRFs or discriminative RBMs, make predictions by conditioning on the input attributes. We develop and investigate variants of conditional herding, and show that conditional herding leads to practical algorithms that perform better than or on par with related classifiers such as the voted perceptron and the discriminative RBM.
منابع مشابه
Herding as a Learning System with Edge-of-Chaos Dynamics
Herding defines a deterministic dynamical system at the edge of chaos. It generates a sequence of model states and parameters by alternating parameter perturbations with state maximizations, where the sequence of states can be interpreted as “samples” from an associated MRF model. Herding differs from maximum likelihood estimation in that the sequence of parameters does not converge to a fixed ...
متن کاملNear-Optimal Herding
The Herding algorithm is an algorithm of recent interest in the machine learning community, motivated by inference in Markov random fields. It solves the following sampling problem: given a set X ⊂ R with mean μ, construct an infinite sequence of points from X such that, for every t ≥ 1, the mean of the first t points in that sequence lies within Euclidean distance O(1/t) of μ. The classic Perc...
متن کاملImpact of Herding on Buy & Hold, Momentum & Contrarian Strategy in Tehran Stock Exchange
This paper aims to study the effect of herding on buy and hold, momentum and contrarian strategy. In this research, the cross-sectional absolute deviation is used to identify herding behavior in twenty industries in Tehran stock market. It is observed that the down and boom periods had more industries with herding. Moreover, the weak herding is more common than the strong herding in this market...
متن کاملStrategic and situation analysis of camel herding in Kalkooyi nomads territory in Qom Province
Owing to premium properties such a transformation of forage with low quantity and quality into high quality dairy and meat products, compromising with arid and semi-arid rangeland and resistance against diseases, camel has basic function in extensive grazing systems. These properties have made camel herding as one of the strategies in sustainable development in natural resources management and ...
متن کاملImpacts of Economic Variables on Herding Behavior in Tehran Stock Exchange Industries
The stock market is influenced by other parallel markets and macroeconomic variables; such variables have impacts on the behavior of financial market players. Accordingly, this study first examines the existence of herding behavior among investors in the Tehran Stock Exchange (TSE). It then investigates the effects of exogenous economic variables on this industry-level behavior in the Tehran St...
متن کامل